🕷️️ Job Radar • SCRAPING

freelancer.com 🟡 2026-05-24

🔹 Scalable Indeed Job Data Pipeline
👤 Client: 🇮🇳 Bangalore, India Member since 2016-04-19
💰 Price: $170 Average bid
🚩 Problem: Need for hourly synchronized job market data with high-reliability company domain resolution and anti-bot evasion.
📦 Existing: Not specified

Specifications:

[Target] Indeed job listings
[Method] Hourly automated refresh
[Method] De-duplication logic
[Method] Company domain lookup via search/URL parsing
[Stack] Python
[Stack] Playwright, Puppeteer, Scrapy, or Selenium
[Stack] PostgreSQL or MongoDB
[Security] Proxy rotation
[Security] Stealth headless settings
[Security] Adaptive delays
[Format] Fields: Job Title, Company Name, Company Website, Description, Salary, Skills, Experience, Location, Apply URL, Posted Date

Workflow:

1. Implementation of proxy rotation and anti-bot stealth layers.
2. Development of crawler for target job fields.
3. Integration of company domain resolution logic.
4. Setup of de-duplication layer and database schema for scale.
5. Configuration of hourly automation schedule.